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(57) Abstract 

A method and a system in which a computing syste m vjSfans^^ to theVlnterneL A memory of the 

computing system contains an o^raj^:^ys6 snj, a cache associated with ffie o perauj^ a nfaccess server . The 

shared librarv^ isjrj&sponsive t o a^systemTcall^fobaMiet b v determining whether alpalii^a^j^o r^the fil e is^baated u nder Va^personaT; name 
space in the mem ory a n d. by i ssu in g "a^reqlieSt^f or " retriev ing the- -fi le'}frorn <an ^ntemet^resource tbased on th e patft '.name located untierjrhc 
personal name space when the file isnot stored in the cache jn^haslTpa^ personal name spac e. An ac cess s erver, 

in response to th e request j fro m the shared^Ubrar y. Slelecis an s^pprblfriate^ the fiteTT rorn the I ntern et resou rce 

andTrerne jve s^'thenrile Vrom ' the Internet resource. The shared 1 ibrary menissue^&Te^yste m call to the operati ng sy stem w hen the access 
server retrieves'' the" file. The access server restores the_file to the Internet resource when the application closes uSTlfie. 
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CROSS-REFFRENCE TO R ELATED APPLICATIONS 

The present application claims priority to United States 
provisional patent application Serial No. 60/019,303 to C.H. Rao, filed June 7, 



1996, and enuded (^Imegra.ting The Internet Into A Fi 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to the field of computing. More 
particularly, the present invention relates to a method and a system for 
10 accessing resources that are available over the Interne t. 

2. Description of the Related Art 

As more resources become available over the Internet, it is 
becoming increasingly difficult to locate, manage flndjntgffrate resources such 
15 as Web page s, Gopher information , Network News, released docummts and 

technical reports, public domain software, and collaborative sources and drafts. 
Resources connected to the Internet are accessed using a na ming schem e that is 
defined by the Uniform Resource Locato r (URL) prot ocol, which has become a 
de facto standard. Internet resources are also accessed using other standard 
20 access protocols, such as th e File Transfer Protocol (FTP) for file servers, the 
Hypertext Transport Protocol (HTTP) for web servers, th e gopher protoco l 
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(COPHEK, for gopher -era, * *=* N-S!*^^ 
for _ serves, - thej^h^^ ^ « «~ 

p ~^ss protocols ^J--e«S*> 

5 "^7h=^PC have been induced for conveniently M 

networ* aod — « ' " ta ^ 

. o1 urnwsers are limited and do not 
and retrieving resources, such convenoonal browsers ar 

Tend themselves for integration into larger toolsets. 

Several systems have been developed for maldng^ojiles 
10 over the Intent caster and raora^t. For esample, me^i* 

" — „de area ftle se.ee by ending the scope of file systems 

— — T «nu/ever the Andrew File 

from a Loca! Area Network (LAN) «o thelnternet. However, 

i not the standard Internet protocols previously 
System uses its ownjrotocol, not thejtanoar 

mH uioned and, conseouenuy, revises an Andrew file server. 

Another system that has been developed for accesstng ft.es over 

dte imerne^ej^^ »— 

and a meS sage-oriented file system 
9 supports a per-process name space and a messag 

■ ^ommteA While different 
protocol so drat a ftle system-lto interface is tmplemented. Wn 

,, tp a the plan 9 operating system is not 
20 access protocols are accommodated, the Flan p* 

, a ^mels and the applications running 
transparent to existing application tools and kernels and 

on the kernels require modification for use with Plan 9. 
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The ^e^ilejSyistem jprovides .^sparent read access to Internet 
resources by being built on top of the existing Netw ork File Svstem£(NI^L 
with an \Alex server]b eing added as a Virtual File System (VFS) interface. 
Hosts on a LAN use t he NFS p rotocol for sendin g calls to the Alex server. 
5 The calls pass through an NFS c lient on a kernel that is local to the NFS server 
kernel on which the Alex server is running The calls are then upcalled from 
the NFS server kernel to the Alex server. Nevertheless, the NFS protocol 
causes th e Alex sys tem to be limited because, while th e NFS protocol 
implements file serv ices, no information has been provided regarding a process 

10 initiating a request, which is important for implementing an authenticated 

access. Co nsequently , th ^Alex syster^onlv supports limited file-oriented file 
access, su ch as an anonymous ^^^ceis. 

Th effi ade Hie System p rovides a uniform w ay for nami ng and 
accessing files in an Internet environment using a new personal name server 

15 that integrates a,heterogen^ of underlying existi ng file systems 

that may not be modified because of a utono my. A private name space can be 
defined by each user that supports two features: multip le file systems are 
allowed to be mounted underjone ^directory^^and one logical name space is 
permitted for mounting other logical name spaces. However, the Jade File 

20 System does not use URL naming. Instead, a separate name server is provided 
for a pathname. Further, individual access servers must be mounted and the 
program running on the host must be recompiled before a user can access a file 
system. 
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TheMulggS nimr^ional File System (n^FSjis atogical file 

_ as »jta, allows new «vfc« g .UMSJ^S^StSf" with ° U ' 
requiring applications or tte operating system kernel to be modified. Thejt. 

MS u^^on^S^a " lmical ffle sysems ' " M PrOVl '' e 

5 Movement Internet access using existing protocols. 

What is needed is an Internet file system that transparently uses 
existing protocols in connection with existing operating system kernels, 
applications and file servers for accessing Internet resources. 

10 CITMMAKY OF T"F "JVT-NTION 

The present invention provides an Interne: fijcjtygegi that 
^_ t ™ ES enf ! y uses^xistingJHS^n connection with existing operating 
system kernels, applications and file servers for .accesstng Wen* resources. 
Consequently, an application programmer can use the same system calls to 
handle files, whether stored locally or at Internet resources. The advantages of 
the present invention are provided by a merited and a system in which a 
computing system having a processor and a memory transparently accesses 
resources connected to fine Wen* The memory of the computing system 
contains an operating system, a cache associated with the operating system, a 
20 WHVmm and an access server/ The shtfed library is responsive to a 

system call for a file by determining whether a path name for the file is located 
under a personal name space in me memory and by issuing a request for 
retrieving the file from an Internet resource based on the path name located 
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under the personal name space when the file is not stored in the cache and has a 
path name located under the personal name space In response to the request 
from the shared library, the ac igess ^server selects an Appropriate a ccess protoc ol / 
for retrieving the file from the Internet resource and retrieves the file from the 
Internet resource. The shared library then issues the Jystem call /to the 
operating system when the access server retrieves the file. The access server 
restores the file to the Internet resource when the application closes the file^J 



BRIEF DESCRIPTION OF T HE DRAWING 
10 The present invention is illustrated by way of example and not 

limitation in the accompanying figures in which like reference numerals indicate 
similar elements and in which: 

Figure 1 is a block diagram of the architecture of a. system 

according to the present invention; 
15 Figure 2 is a block diagram of a system having an architecture 

that supports coherent sharing for different applications according to the present 
invention; 

Figure 3 illustrates the concept of a personal name space (PNS) 
according to the present invention; 
20 Figure 4 shows a diagram illustrating the mounting of remote file 

systems according to the present invention; 

Figure 5 shows a flow diagram of a validation process according 
to the present invention; and 
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validation process of Figure 5. 



10 



15 



tinn relates to an Internet File System (IFS) that 
The present invention relates 

use, to manage — - " » ^ ^ ^ ^ f 
^ rating • — ^ " ^ 

„ or change . — • - — — ^ """" — " 

^,tina wstem and applications running 
introduces . logical layer between an operaong sysrem 

s— H^ce .a, ,e un^P^*"^ * *** 
" c in the same address space as the application 

layer of the present invention runs in the same 

• • „ orv-mtinE svstem modifications, 
without requiring operating sysic 

According ro the invenbon, each user ^ Internet fries for 

J — a global nante .ace. According „ » r~ 

tendon, a PKS is privare and rentains undeftned ,o al other user, Oniy *e 
OW ner dre PHS has access ro rbe PH, A PHS can — '« — " 
. shared nanre space or ro anorber name space rbai supports nan.ng. 

ttrt names of the files as 
, Internet files can be accessed directly using the URL nam 

pathnames. For example, a home page identified by 

http://www.att.com/research.html is named 

u where - /IFS is the mount point on s 
~ /IFS/http:/www.att.com/research.html, where 
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local file system for a PNS. Additionally, a PNS supports mount operations 
that attach name spaces of Internet file servers to nodes of the PNS using access 
protocols, such as File Transport Protocol (FTP). Thus, a PNS allows a file 
system to name and access files, and to perform mounting operations that 
5 support location-independent naming. 

Figure 1 is a block diagram of the architecture of a system 
according to the present invention. System 10 includes a processor 1 1 coupled 
to a memory 12. Memory 12 includes memory space for storing an operating 
system kernel 13, a cache 14 for kernel 13, at least one application 15, such as 

10 a browser, a shared library 16 and an access server 17. Processor 11 and 
memory 12 can be physically located within a single device or can be 
configured as a plurality of processors and memory devices that are distributed 
using well-known LAN techniques. A plurality of applications can also be run 
by system 10 using well-known techniques. 

15 p When application 15 sends a request or system call to kernel 13 

for opening, reading, writing, ^losing, etc., afile, for example, the request is 
received by a logical layer 22 that includes shared library 16 and access server 
17. Preferably, shar<^:lfo presents applications with a complete POSIX 

system interface. Shared library 16 is linked by application 15 and runs in the 

20 address space of application 15. Ail of the necessary functionality for handling 
system calls is provided by shared library 16. According to the invention, 
shared library 16 includes a capability for handling a PNS, that is, shared 
library 16 is capable of determining whether the pathname for a file specified in 
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a ^ caii U under . PNS for a use, of *= ■ ^ 

^ me is iocated under a PNS, — «b-y 16 — — — * 
5 fll e shared Uhrary .6 CO.— *e re,ues, from - « » 

Por syaen* *. prcide dyna^ — • 

u a Kh«rv 16 For computing systems without 
search path to include shared library 16. 

. . . r< ,i; n ked with shared library 16. 
10 dynamic shared libraries, applicauons must be relinked 

Access served seleets the appropriate access protocol for the 

- server 19 via the Internet 18, and obtains the 
specified file, connects to remote server 19 

m «norv 20 from remote server 19. Access 
specified file which is stored in memory 

_ „ U capahie of . - — °' - — * 

15 "on hehaif or a - who is nrnnh. applied .5. T~ is. — -er 

„ access remore fl. servers -* * — ^ T ° * 

«, shared Uhrary 1< is capahie of — — « » «~» — £ 
Once *. spccifcd Be is obtained, access server .7 caches 0* 

20 each a g enr imp—* a parted access prorocoi. Hgure , shows 

^ rhree hasic funcdons of — • — * «- " * ^ 
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name space, retrieving a remote file and restoring a file to its primary server. 
The functions of retrieving and restoring are mapped to corresponding 
commands supported by specific protocols, while the function of mounting is a 
local operation. 

5 Recess .seiner: 17 maintains a mounting database for each PNS 

defined within system 10. Information required for accessing an Internet file, 
such as the 'access protocol, the host, authentication information, remot e path 
information, etc., ar e stored in the database. Each entry for a PNS also 
includes th e mount point for the PNS. Access server 17 refers to the mounting 

10 information in the mounting database for locating, retrieving and storing the file 
in cache 14 of the operating system kernel 13 . Access server 17 sends an IPC 
message to shared library 16 when the specified file has been cached. Shared 
library 16 then retrieves the specified file from cache 14. When the filed is 
closed by application 15, access server 17 restores the file back to remote 

15 server 19. When the specified file is a local file, that is, stored locally 
elsewhere within system 10, shared library 16 directly accesses the file. 

Preferably, an Internet file is cached in its entirety on the local 
file system when it is opened because remote file servers are contacted only for 
system file "opens" and "closes" and not for individual reads and writes. In 

20 this manner, the total network overhead incurred by transmitting a file is lower 
when the entire file is retrieved rather than as a series of system requests and 
responses for individual pages. Since accesses to files over the Internet are 
expensive in terms of overall system resource consumption, when a cached 
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copy of a me is accessed, ** " ^ *" " 

*. cached are consist with master copy da* stored in ft. remote server. 

While a single access server 17 is shown in layer 22 in Figure 1, 
. piuraEty of access servers can he used. For esample, a hasic configuration of 
5 Ute present invendon can include an access server 17 for each system user and 
a system wide name server for locadng each user's access server. 
Anenratively, groups of users can share a particular access server 17. The 
presem invention also allows file servers located on the interne, to he mount* 
as oset-level implementations, as shown in Figure 2, rather man as a kernel 
10 implementation as in convent system, In Figure 2, each shared library 16 
rtat is associated wirh a process 23 direcdy accesses access server 17, tamer 
.han me apptication being processed through an associated kernel, me NFS 
prot oco, (not shown) and an access server (no, shown), as is presendy done in 
the prior art. 

15 Figure 3 illustta.es the concept of a PNS within a local file 

system 30. A firs, PNS 31 is shown mounted .0 local fde system 30 at 
ta^IFS and owned by the user Boh. A. second PNS 32 is shown 

, l -.,, m „/rps and owned by the user Stephame. A PNS 
mounted at /home/stephame/tmp/IFS ana owneu j 

i5 defined by the directory pair (MountPoint, CacheDirectory). where 

20 MoutttPoint is a loca! pathname in me file system to which PNS is mounted or 

anached, and CacheDitectory is a local directory in which remote fdes and 

stories are cache,. Essentially, MountPoint indicates where the mount is 

pointing, in Figure 3, me mount point for PNS 3. is Wbob,IFS and the 
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mount point forPNS 32 is /home/stephanie/IFS. Cachedirectory is needed in a 
file system structure as a place to put a cache file. To simplify the task of 
maintaining multiple PNSs, the present invention uses a single directory called 
an IRoot for a MountPoint and a CacheDirectory. An ERoot is a mount point 
5 for a PNS and a physical directory on the local file system where remote files 
and directories are cached. That is, an IRoot includes the mount point and the 
cache directory. A user defines a PNS by specifying the IRoot using the 
command iroot: 

$ iroot pathname 

10 As shown in Figure 3, the IRoot for PNS 31 is defined to be 

/home/bob/IFS, while the IRoot for PNS 32 is defined to be 
/home/stephanie/tmp/TFS. PNSs 31 and 32 are each mounted on local name 
space 30. Files and directories located under PNS 31 (/home/bob/IFS) are 
accessible only to the particular user defining PNS 31. To other users, such as 

15 the user who defined PNS 12, the files and directories under /home/bob/IFS are 
undefined. 

The Universal Resource Locator (URL) naming scheme is 
embedded within the system of the present invention. The URL naming 
scheme has the form: 
20 protocol ://user:password@host:port/path 

where "protocol" is the access protocol, "user" is an optional user name, 
"password" is an optional password, "host" is the fully qualified domain name 
of a network host or its IP address, M port n is an optional port number to which 

- 11 - 

SUBSTITUTE SHEET (RULE 26) 



^SDOCID: <WO 



9746&56A1 I > 



BNS nanfi 1 



WO 97/46956 



PCT/US97/09295 



» connect to, and -pa*' is the path used by the remote server for access 
d. desired resource. The aocess protocol not only provides the key «o 
accessing Internet resources located on remote servers, but also hides the 
heterogeneity of a system on which the accessed server is located. That is, 
5 once an access protocol becomes available, ir is possible «o access resources 

t , „ mtoco i without regard to the machine type or 
provided by a server usmg the protocol wkouu b 

t ♦v,- -n« Consequently, the present invention 
the operating system of the server, uonsequc „ 

supports a heterogeneous collection of access protocols. 

Table I shows exemplary pathnames and corresponding URL 
l0 names with " — IFS" designating the IRoot that includes the mount point and 
cache directory. 
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TABLE I 



IFS Pathname 


URL Name 


- /IFS/ftp:/ftp.ai. nut.edu/pub/README 


FTP:/ftp.ai. mit.edu/pub/README 


- /IFS/rshz/kdng/src 


rsh://king/src 


-/IFS/http:/research.att.coTn/people/list-html 


http://research.att.com/people/list.htmJ 


~/IFS/nntp:/ulysses/comp.os.research/5364 


nntp:// ulysses/comp . os. research/5364 


— /IFS/gopher:/csie.nctu.edu.rw 


gopher://csie.nctu.edu.tw 


- IFS/ftp:/john:xxx@gryphon/home/john 


ftp://john:xxx@gryphon/home/john 


- /IFS/http:/jade:8000/project/DAF.html 


http://jade: 8000/proj ect/D AF . html 


/IFS/http/192. 127. 159.32:8000/IFS.html 


http://192. 127. 159.32:8000/IFS.html 



The following exemplary pseudo code opens a home page using 
the system call openO, reads a file located at a URL name using the system call 
readO, processes the contents of the file as raw data, and closes the file using 

15 the system call closeO: 

fd = open( u - /rPS/httpr/research.att.com^ooks.html" , 

0_RDONLY); 

while ((num = read(fd, buf, nbyte)) > 0) 

20 /* process data in buf */ 

} 

close(fd) 

- 13 - 
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T* present invention lao provides that an Internet resource can 
„e iocaied, managed and interacted with using exisdng commands and toois. 

For example, the command line 

$ls _/IFS;nnrp:/ulysses/comp.os.resealch/" 

. „ -search" that aie stored on the News 

5 lists articles in the news group -comp.os.researcn tna 

server "ulysses.- Addidonally, the command line 

$ grep thread - /IFS/nnrp:/ulyss=s/comp.os.r=search/' 
searches for me Keyword "thread- in the News group -comp.os.research-. 

Mounung aBows shortcuts ,o he created when naming flies hy 
providing indirect naming and aiso maintains authendcadon informadon for 
citing remote server, Addidonally, moundng allows a proxy server to he 
^eu through which me present invendon accesses a desired flic server. 

15 space, such as PNS. to another name space. The mount operadon can attache a 
PHS on top of a glohal name space, and can attach a remote ftle system to a 
PNS. 

A mount point is specified by the command mount: 
$ mount URLName MountPoint [ProxyServenPort] 

20 [ValidPeriod] 

where "UKLName- is the name of a fde/directory accessibie over the 
„ -MountPomf is the deflned mountpoint in a PNS (for example, IPS m 



10 
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Figure 3), "ProxyServer" is an optional proxy server parameter, and "Port" is 
an optional parameter specifying the tcp port of the proxy server. 

When the ProxyServer and Port parameters are specified, the 
present invention accesses the specified remote. server through the specified 
5 proxy server. The parameter ValidPeriod (in seconds) specifies a time period 
during which cached files under the mount point are considered to be valid. 
Specifically, when a file is accessed, the cached file can be used when its age is 
still within the specified ValidPeriod. If ValidPeriod time has expired, the file 
must be obtained from the network. The URLName may contain a user name 

10 and a password, and when present, the present invention authenticates access to 
the remote server on behalf of the user using the password. If the value of 
password is the mount command preferably requires the user to enter the 
password at the next prompt. 

Figure 4 illustrates how remote file systems are mounted 

15 according to the present invention. In Figure 4, remote file systems that use 

different protocols are mounted to the IRoot /home/bob/EFS (PNS 31 in Figure 
3). File server 40 at gryphon.att.com is mounted to /home/bob/IFS as follows: 

$ mount ftp://bob:-@gryphon.att.com.home/bob 
/home/bob/IFS/research 

20 Password: ****** 

This command mounts the directory bob, located in the file server 40 on 
gryphon.att.com, on PNS 31 at the node -/home/bob/IFS/research using the 
ftp protocol. In this example, the command mount prompts Bob to enter a 
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USH sob — ^ - — — 

^ dre corresponding - - " — * ** ' ~ 

a Another example of the mount command 
Bob's entered log-in and password. Another examp 

5 S mount rsW/Wnomeyrao/proiect /Home^/IPS/pr.ect 

located in the file server 41 at Vang, on 
For this example, the directory project, located 

«. n,oh/!FS/oroiect via the rsh protocol, which 
PNS 3 1 at the node - /home/bob/IFS/projec 

« Users specify user names and passwords 
provides authenticated accesses. Users speci y 

t m takes authentication information from the .rhosts 
inside URLName. The system takes authe 

. h .directory This avoids passing password information 
file in the user' s home directory . 

through the network. 

In mowing rr^l. of the mounting command, a mount 

noint is- created using an anonymous ftp access: 

Jm o U n,^-n.^^^ b ~ ffi< 

radish: 8000 

- snnn is used for accessing tsx- 
where the pro,, server on radish on the port S00O used 

■ file server 42 on tsx-ll.mit.edu 
U .mit.edu. The remote directory hnux in the file serve 

for this example is mounted on the node linux in PNS 31. 

two methods for controlling cache 
The present invention provides two metnoa 

First an attribute ValidPeriod, assigned using mount 
validation processes. First, an attnou 

• l. u Hiwetorv Each directory inherits 
commands, is associated with each directory. 

a ^rhed copy of a file under a created 
ValidPeriod from its parent directory. A cached copy 
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directory is treated as valid, without checking its primary copies, if the copy 
was retrieved during ValidPeriod. For example, if ValidPeriod for a cached 
file is set to be 7200 seconds, the cached copy is considered as valid for 7200 
seconds. When ValidPeriod is the cached copy is always considered 
5 valid. When ValidPeriod is "0", the cached copy is always invalid. 

ValidPeriod can be changed dynamically like many other attributes associated 

with directories. 

For the second validation control method, a per-process mask, 
referred to as ValidMask, is provided for overwriting the ValidPeriod of a 

10 directory. A child process inherits ValidMask from its parent process and a 
built-in shell command vmask is used for defining and updating the process 
ValidMask. The per-process ValidMask has higher priorities than the per- 
directory ValidPeriod. That is, when dealing with a particular type of file, the 
valid time is determined according to the mounting, i.e., the file desired to be 

15 accessed. When considering the purpose for using the file, the valid time is the 
time of the process according to the application, i.e., the time the application 
uses the file. Thus, with ValidPeriod, cache validation processes can be 
controlled according to types of Internet files, such as co-authored papers 
versus Network News, whereas, ValidMask allows overwriting ValidPeriod on 

20 the process level in special circumstances, such as refreshing cache 14. 

Figure 5 shows a flow diagram for a validation process 50 
according to the present invention. At step 51, it is determined whether the 
requested information is in the cache. If the requested information is in the 

- 17 - 
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• „„ 52 where it is determined whether the cache is 
cache, flow continues to step 52 wne 

, .. flow continues to step 53 where 

valid under ValidPertod or ValidMask. M so, flow co 

5 l^.herea^eissentflo^es^^totheacceas^e, 

u , ..met is accessed, the information is 
How continues to step 55, where the Internet 

retrieved and then is stored in the cache. 

*n nf the details of step 52 ot 
Figure 6 shows a flow diagram 60 of the deiai 

„. it is determined when the cache 
wocess 50 shown in Figure 5. At step 52A, it is de 
P 52B me las. update time is compared with 

„ was last updated. Then, at step 52B, » ^ 
VaUdPeriod or ValidMa* for determining whether me cached py 
^.present invention identifies i«lf to a server for 

, chared library 16 and access server 17 

-P— ' inS " " J Less server 17 ohtains 

„ sha^d « * — - - — * * * ^ . te 

f m chared library 16 for informing servers connec 

information from J ^ fc ^ 

_et hecause access server^ s 

ofte user maidng a system call rcuest. ^ 
„ itself to access server .7 before me access server 

20 authentication. — 
The present invention also supports both 
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using a proper login name and password information for accessing files. An 
authenticated access includes a handshaking process in which shared library 16 
First communicates with access server 17 that a request is to be authenticated. 
Access server 17 then communicates to shared library 16 that a file is to be 

5 created for obtaining a time stamp. Shared library 16 identifies the file to 

access server 17 once the file has been created. Access server 17 then accesses 
the file created by shared library 16 for confirming the information. 

While the present invention has been described in connection 
with the illustrated embodiments, it will be appreciated and understood that 

10 modifications may be made without departing from the true spirit and scope of 
the invention. 
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